🕷️️ Job Radar • SCRAPING

freelancer.com 🟢 2026-05-28

🔹 Automotive Parts Large-Scale Extraction System
👤 Client: 🇺🇸 Miami, United States Member since 2021-04-29
💰 Price: $378 Average bid
🚩 Problem: Incomplete product indexing in site navigation requires search-query simulation and index traversal to capture 250k+ items.
📦 Existing: Target URL: ulti.cl

Specifications:

[Target] 250,000 automotive parts from ulti.cl
[Method] Search-query simulation, site-wide index traversal, sitemap parsing
[Method] Rotating residential proxies, user-agent randomization, request throttling
[Stack] Python, Playwright, Scrapy
[Stack] SQLite or PostgreSQL for persistent storage
[Format] CSV, JSON, or Database Dump
[Format] Local mirrored folder structure for high-quality images
[Security] Anti-bot bypass and dynamic content handling
[UI/UX] Automated runtime logs (scanned pages, saved items, failed URLs)
[UI/UX] README for selector and parameter updates

Workflow:

1. Sitemap parsing and product ID traversal to identify hidden inventory.
2. Automated search-engine simulation using automotive keywords and part numbers.
3. Dynamic content extraction via Playwright/Scrapy with proxy rotation.
4. Data persistence to SQL database to prevent memory bottlenecks.
5. Local image asset downloading and mirrored directory organization.
6. Final export to CSV/JSON with runtime reporting.